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RDECO!^^  Interoperability 


The  Future:  Interoperable  unmanned 
systems  working  hand  in  hand  with  Soldiers 

y 


•  Joint  Shared 
Integrated  Picture 

•  Increased  Force 
Survivability 

•  Increased  Operational 
Lethality 

•  Sensors,  Shooters, 
Command,  Control  & 
Communications 

Reconnaissance  / 
Surveillance 


Today:  Teleoperated,  dedicated 
control  unit,  COTS  systems 
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RDECon/!^  Payload  Integration 


Common  payload  interface  across  platforms  by  mission  or  class 

Family  of  unmanned  ground  systems 


Payload  Interface  Standard  Architecture 


Payload  A 

■  ■ 

Payload  B 

■  ■ 

Payload  C 

■  ■ 

Payload  D 

■  ■ 

Payload  E 

Mission  equipment  payioads 
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Maneuver 


Manuever 

Support 


Sustainment 


lED  Defeat  Systems 
Disarm  /  Disrupt 
Reconnaissance 
Investigation 
Explosive  Sniffer 


Area/Route  Clearance 
Mine  Neutralization 
Counter  lED 
CBRNE 


Common  Robotic  Kit 

EOD 

Convoy 

Log/Resupply 
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RDECOM 


Interoperability  Top  Level 
Schedule 


FY2009 


2010 


2011 


2012 


2013 


2014 


2015 


2016 


Interoperability 
Develoffment/ 
Demonstration 
SOW  Finalized 


A 

Industry 

Day 


Start  Interoperability 
Spec  Bid  1 


Data 

From  M&S 


Demonstration 

Completed 


Data 

Analyzed 


A  A 

Start  Spec  Bid  2  Start  Spec  Bid  3 

A  A 

Spec  Bid  1  ^  Spec  Bid  2  ^ 

M&S  M&S 

Test  Spec  Bid  1  Test  Spec  Bid  2 


A 

Spec  Mod  Bid 


Spec  Bid  3  A 
Complete 

M&S 

Test  Spec  Bid  3 


1 

1 

- 1 - 

PM  RS  JPO  Interoperability  Profile  Formulation 

1 

1 

PM  UAS  ICWG  1 

/  Preliminaryl 

- T - 

i 

V  RQ  JPO  Particination 

CDD  &  TechDevelopment  b 

1  \w  wl  1  Cli  LIOI kyCI llwl  1 

AEODRS  c  r 

V  Schedule 

1 

1 

J 

FunctTonal 


start  Work  on  Specification  Build 


Requirements 

Comms 

Architecture  (System  &  Sl/l/J 

Controller 

Payload 

Power 


jJCRVSILDev 


SIL  Test 


Test 


a: 


Test, 


A 


Test 


7\: 


Test 


A 


IGS  -  Interoperability/Control  3  Robots 
Development.  Effort 


} 


RS  JPO 

Input/ 

Participate 
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RDECOiwlk  TARDEC  Joint  Center  for  Robotics 


*  S&T  Support  to  the  RS-JPO 

*  Develops  and  Fosters  external  Relationships 

*  Matures  technology  for  Insertion  into  ATO  programs 

*  Robotics  Outreach 

*  RS  JPO  Collaboration  Cell  Lead 

*  Support  to  IGS  Capability  Cells 

*  Robotics  Academic  Programs  (Including  Curriculum  Development) 


Industry  Partnerships 

Academia  Partnerships 

ABB 

Auburn  University 

BAE 

Carnegie  Meiion 

Delphi 

Lawrence  Technologicai 

Ford 

University 

General  Dynamics 

Massachusetts  Institute  of 

General  Motors 

Technology 

Google 

Michigan  State  University 

i  Robot 

Michigan  Technologicai 

JADI 

University 

John  Deere 

Oakiand  University 

Lockheed  Martin 

University  of  Detroit  Mercy 

Oshkosh 

University  of  Michigan  - 

Polaris 

Ann  Arbor 

QinetiQ 

University  of  Michigan  - 

Quantum  Signai 

Dearborn 

Raytheon 

US  Miiitary  Academy  at 

SoarTechnoiogy 

West  Point 

Think-A-Move 

Virginia  Tech 

Toyota 

Wayne  State  University 

Government  Partnerships 


Community  Outreach 


sm/mR 


TRADOC 


IGVC 


FIRST 


Robofest 


Robotics, 
Engineering  and 
Technology  Days 

TARDEC  Robotics 
Quarterlies 


RDECOM^  TARDEC  Intelligent  Ground  Systems 


Mission 

Integrate,  Explore,  and  Develop  Robotics,  Network  and  Control  Components  with  a  Focus  on  Customer 
Driven  Requirements  to  Provide  Full  System  Solutions  to  the  War  Fighter 


Transition  and  Requirements 
Development 


Tech 

ransfer 


w 

S' 

Initial 

Capabilities 

Document 

(ICD) 

- C5“ 

Integration  Technology  Development  Lessons 
Learned  to  Enable  Early  Technology  Insertion 


Military  Relevant  Test 
&  Experimentation 
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RDECon/ilk  TARDEC  Robotics 


Autonomous  Behaviors 


Warfighter  Support 


360°  Situational  Awareness 


UGV  Safe  Operations 


Architecture  Deveiopment  & 
Demonstration 


Human  -  Robot  Interface 
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RDECOM^  Recent  Warfighter  Experiments 


Near  Autonomous  Unmanned  Systems 
ATO  Capstone 


Convoy  Active  Safety  Technologies  (CAST) 


Robotic  Vehicle  Control  Architecture 
In  collaboration  with  PM-FCS  (BCT) 


Robotics  Collaboration  ATO  Capstone 
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RDEOO!^^  Robotics  for  Current  Operations 


Under  Vehicle  Inspections 


Construction  Engineering  Robotic  Kit 


Remote  Mine  Detection  System 


Robotic  Decontamination 
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Robotics  Rodeo 


robotics 


^HE  Phantom  Corps 
AMERICA'S  ARMORED  CORPS 


Autonomous  Detection  Vehicle 

•  Autonomous  route  investigation  and  hazard  marking 

•  Fundamentally  an  applique  kit  for  Husky 

•  Funding  exists  for  developmental  phase  (JIEDDO  to  NVL) 

•  Leverage  previous  work  by  GDRS  for  NVL 


Convoy  Logistics 


•  Kit-based  system  for  TWV  automated  leader-follower 

•  User  assessment  at  Fort  Hood  in  the  September  -  October 
timeframe 

•  Funding  exists  for  developmental  phase 

•  Potential  to  leverage  JCTD  for  cycle  development 


Manned/Unmanned 
Teaming  (MUT) 

•  Large  armed  robotic  platform  assumes 
role  as  a  member  of  squad  /  formation 
•Leverage  existing  ARDEC,  AMREC, 
CERDEC  technologies  and  Fort  Hood 
rodeo  for  target  acquisition  and 
engagement  capability 


Robotics  Rodeo 

•  Input  from  Army  needs  (ONS) 
Demonstration  of  related  state  of  the  art 
technologies 

•  Provide  user  and  SME  feedback 
to  industry 


Persistent  Stare 

Small  robot  with  autonomous  navigation 
to  perform  recon  and  surveillance 
Utilize  robotic  rodeo  to  demonstrate 
vendor  capabilities 


VOIED  \/  Defeat 

•  Capability  for  autonomous  VOIED  defeat 
Utilize  robotic  rodeo  to  demonstrate  vendor 
capabilities 


Target  Ik 


RDECon/!^  Future  Force  Technologies 


_ _ •  ■ _ : _ _ '  •  jfe* t 

Robotics  CTA  -  Technology  for 
Near  Autonomous  Systems 


Command  &  Control 
of  Robotic  Entities 


Robotic  Platform  for 
Engineer  Missions 


MAST  CTA  -  Small  “Creatures 
for  Urban  Terrain” 


Air-Ground  Collaboration 


Following,  Awareness,  SafeOps, 
and  Tracking  through  IGS  (fastIGS) 
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RDECOM 


Crewstation  Interface  and  Control 
Advancements 


PAST 


•Workload  reduction 
•Embedded  crewstation 


PRESENT 

•Robotic  control  (mounted,  dismounted) 
•Driving  aids  (Soidier  assist) 

•Scaiable,  portabie  interface 


FUTURE 

•Soldier  monitoring  and  task  assist 

•Intelligent  agents 

•360  degree  situationai  awareness 
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RDECOM 


Manned  And  Unmanned  Vehicle 
Systems  Integration  Lab 


Purpose:  Incorporate  actual  hardware  both  fielded 
and  prototypes  using  simuiation,  stimuiation 
and  emulation  to  test  concepts  and  validate 
capabilities. 

•  Hardware  In  The  Loop  includes: 

-  Vehicle  Warfighter  Machine  Interface 

-  Dismounted  Controliers 

-  FBCB2  and  other  ABCS 

-  SoSCOE 

-  Autonomous  Controi  Algorithms 

Partners: 

•  Robotic  Systems  Joint  Project  Office  (RS-JPO) 

•  Cross  Command  Coilaboration  Effort  (3CE) 

•  Natick  Soldier  Center  -  Infantry  Warrior 
Simulation  (IWARS) 

•  Night  Vision  Labs  -  Comprehensive  Munitions 
and  Sensor  Server  (CMS2) 

•  Modeling  Architecture  for  Technoiogy,  Research 
and  Experimentation  (MATREX) 


RDECO!^  ARL  Robotics 


Micro-Autonomous  Science 
&  Technoiogy  CTA 


RDECOM 


Robotics  CIA  Members  and  Objectives 
Current  Consortium 


Consortium  Members 


■  General  Dynamics 
Robotic  Systems 
(Lead  Industrial  Partner) 

■  Carnegie  Mellon  University 

■  Applied  Systems 
Intelligence 

■  Jet  Propulsion  Laboratory 

■  Alion  Science  & 
Technology 

■  BAE  Systems 

■  Sarnoff  Corporation 

■  SRI  International 

■  Florida  A&M  University 

■  University  of  Maryland 

■  PercepTek 

■  Robotic  Research 

■  Signal  Systems  Corp 

■  Howard  University 

■  NC  A&T  University 

■  University  of  Pennsylvania 

■  Skeyes  Unlimited 

■  Johns  Hopkins  University 


Make  the  research  investments  that  TlChntCAl  Avm 
support  the  Army’s  robotic  system 

development  goals:  ■  Advanced  Perception 


•  Develop  perception  technologies 
that  allow  robotic  vehicles  to  sense 
and  understand  their  environment; 

•  Develop  intelligent  control 
technologies  and  architectures 
enabling  robotic  systems  to 
autonomously  plan,  execute,  and 
monitor  operational  tasks 
undertaken  In  complex,  tactical 
environments; 

•  Develop  human-machine  interfaces 
that  allow  soldiers  to  effectively  task 
robotic  systems  and  minimize 
operator  workload. 


■  Intelligent  Control  & 
Behavior  Development 

■  Human  /  Machine 

Interfaces  4 


RDECO!^^  Sensors  and  Perception 


) 


Exploration  of  novel  sensor  modes 


for  small  systems  Spectral  LADAR 

...to  expand  applicability  and 
enhance  available  information 

Moving  Agent  Understanding 


In  clutter  &  complexity 


Improved  environmental  understanding, 
especially  for  dynamic  environments 

•  Application  of  learning  techniques 


Terrain  Classification 


Goal  is  fusion  of  multiple 
techniques  to  improve 
accuracy  and  robustness 
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RDECon/iM  Intelligent  Control 


Examining  methods  for  reai-time  pianning 
and  execution  of  compiex  missions 


Integration  of  multiple  planners 
for  real-time  operation 


Off-road 


High  Mobility 


Planning  with  uncertainty 


Full  implementation  of  multi-layer  planning 


Dynamic 

Replanning 

Example 
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RDECOM^  Advances  in  Human  Machine  Interface 


Scalable  Human  Machine  Interfaces 


...to  reduce  soldier  cognitive  workload 


...and  Multi-Modal  Input 
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RDECOM 


A  Vision  of  the  Fut 
The  new  Robotics 


Unmanned  Systems  become 
another  soldier  in  the  unit: 

highly  capable  with  scalable  attributes  to 
meet  mission  requirements;  requiring 
reduced  communication  and  minimal  soldier 
interaction;  flexible,  robust,  and  reliable;  able 
to  adapt  fully  to  new  &  different  tactical  and 
environmental  conditions;  following 
commanders  intent;  effectively  operating  in 
mixed  environments;  able  to  “learn  from 
experience;  maneuvering  unfettered  in 
complex  terrain;  able  to  “live”  in  a  world 
designed  for  humans,  to  grasp  small  objects, 
to  open  doors,  or  to  carry  the  wounded. 


•  What  missions  will  they  conduct  ? 

•  What  level  of  capability? 

•  What  degree  of  autonomy  will  they  possess? 

•  How  will  they  work  with  soldiers  ? 

•  Or  function  in  general  society? 

•  How  will  they  be  used  in  Urban  operations? 

•  In  complex  terrain? 

•  How  will  they  navigate  in  GPS  denied 
environments  ? 
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RDECOM 


Topics  for  Future 
Perception  Research 


Perceive  &  understand  a  dynamic  & 
unknown  environment 


•  Sensors 

•  Information  Fusion 

•  Perception  Algorithms 

•  Aii  environments 

•  Aii  scaies 

•  Relevant  world  model 


Sensing 

•  Greater  resolution  &  range,  lower  cost 

•  Increased  fields  of  view;  focus  of  attention 

•  Scale 

•  All  weather/environments 

Terrain/Object  Understanding 

•  Broader  vocabulary 

•  Recognition  of  cues/saliency  of 
observations 

•  Robust  &  adaptive 

•  Reasoning 

•  Fusion 

Understanding  activity 

•  Human  activity/intent  recognition 

•  Saliency  of  observations/  context  &  cues 

•  Learning 

World  model 

•  Managed  &  validated 

•  Long-term  &  short-term  memory 

•  Collaborative  or  distributed 

•  Common  ground  (HRI) 

•  Navigation  (Intelligence,  mobility  & 
manipulation) 
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RDECOM^  Topics  for  Future 

Intelligence  Reseai 


Plan  and  execute  military  tasks  &  missions 


•  Robust 

•  Adaptive 

•  Learns  from  Experience 

•  Transparent 


Some  potential  research  topics 

•  Learn  &  Adapt 

•  Deductive  reasoning 

•  inference 

•  Generaiization/Ruies  of  engagement 

•  Uncertainty  of  future  conditions 

•  Probabiiistic  reasoning 

•  Spatiai  &  temporai  reasoning 

•  Self-awareness/introspection 

•  Transparency 

•  Providing  non-verbai  cues 

•  Human-robot  coiiaboration 

•  Fauit  detection 

•  World  model 

•  Common  ground 

•  Mixed  initiative 

•  Scale 

•  Adapting  to  resource  limitations 

•  Tactically  intelligent  behavior 

•  Collaboration  between  homogeneous 
&  heterogeneous  systems 
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RDECOM 


Human-Robot  Interaction 


Seamless  integration  of  robots 

into  military  &  civilian  activity  Some  potential  research  topics 

•  Shared  situational  awareness 

•  Aware  of  cultural  and  behavioral  norms. 

•  Comprehend  commander’s  intent  &  act  upon  it 

•  Understand  the  intent  of  surrounding  humans  for 
consideration  in  planning 

•  Possess  common  spatial  &  temporal  frames  of 
reference  -  a  “common  ground” 

•  Trust  &  Confidence 

•  Transparency  of  action 

•  Cues  to  activity 

•  Tolerance  to  failure 

•  Intuitive  Communication 

•  Language  -  unconstrained  dialogue 

•  Non-verbal  cues,  gestures,  context,  &  behavior 

•  Operating  within  society 

•  Adaptable  to  varying  social  cues  &  context 

•  Span  of  control 

•  Effective  Control  of  multiple  systems 

•  Human-robot  Teaming 

•  Seamless  integration  of  robots  &  society 
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RDECO!^^  Summary 


•  Unmanned  Systems  will  have  a  major  impact  on  future  military 
operations 

•  The  technology  is  still  in  its  nascent  stages  -  the  Army  has  made 
a  firm  commitment  to  its  development 

•  The  first  systems,  albeit  teleoperated  are  already  impacting 
current  operations 

•  The  first  systems  with  significant  autonomy  will  be  fielded  over 
the  next  5-10  years 

•  How  the  Army  employs  the  technology  will,  as  much  as  the 
technology  itself,  determine  its  future  impact 
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RDECon/Th  Questions 


